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METHODS FOR INITIATING ACTIVITY IN INTELLIGENT DEVICES 
CONNECTED TO AN IN HOME DIGITAL NETWORK 
USING EXTENSIBLE MARKUP LANGUAGE (XML) FOR INFORMATION 
5 EXCHANGE AND SYSTEMS THEREFOR 

BACKGROUND OF THE INVENTION 

The present invention relates generally to data communications between intelligent 
information and entertainment digital devices (IDDs) forming an in home digital network 
10 (IHDN). More particularly, the present invention relates to a novel way to use extensible 
Markup Language (XML) as a mechanism to initiate action in one or more of the IDDs 
connected to an IHDN to facilitate interoperability and integration thereof. 

A myriad of different intelligent digital devices (IDDs) for providing information and 
fi" entertainment to the user have come into widespread use. These devices include, but are not 
4y limited to, conventional (analog) televisions (TVs) and digital TVs (DTVs), such as high 
|j definition televisions (HDTVs), Direct Broadcast Satellite (DBS) receivers, 
;!\ cable/terrestrial/satellite set-top boxes (STBs), conventional VCRs, digital video recorders 
f U (DVRs), telephones, stereo systems, personal computers (PCs), cellular phones, DVD players, 
fa CD-I players, video game consoles, e.g., the recently introduced Sega Dreamcast system, 
^ Personal Digital Assistants (PDAs), intelligent Remote Control Devices (RCDs), video cameras, 
digital cameras, etc. All of the above-mentioned IDDs incorporate one of a Digital Signal 
Processor (DSP), microcontroller, microprocessor, system-on-a-chip (SOC), Programmable 
Logic Device (PLD), Programmable Logic Array (PLA), or other digital data processing means. 

25 

The rank and file of the computer electronics industry in general and the software 
industry in particular have been searching for the next "killer" applications, i.e., an application 
that could drive the sale of hardware just like the Visicalc program drove the sale of the Apple 
computer. This killer application, as envisioned by many manufacturers, is a single application 
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with a set of features that a consumer would buy for a premium price. A single new device may 
not be this killer application. What may be the application that builds customer loyalty and 
enables widening of profit margins is the ability of a suite of devices to work together to address 
the needs of the household as no single device can. This inter-operability of devices can increase 
5 the value and functionality of the collection of devices in the home and can allow these devices, 
in concert, to provide services that no single device can adequately provide. Thus, one possible 
advance akin to a "killer" application is a consumer friendly software set that could be shared by, 
or distributed among, multiple devices, the ultimate goal being to enable the different intelligent 
devices to work together in a cooperative and integrated fashion, i.e., as if the entire collection of 

10 such devices were a single, distributed, multi-function device. The holy grail of the "home 
electronics" industry is a mechanism that would allow diverse IDDs to exchange data and act on 
the exchanged data in a seamless and transparent manner. Thus, two elements needed to 

(2 implement this "killer" application are a network to connect the IDDs and software permitting the 

J; IDDs to act on shared information. 

!§ 

y With respect to the first requirement, one way to enable this interconnectivity of 

^ consumer devices is to have a communications backbone present in the home. It will be 
s appreciated that this backbone, or network, would allow any capable consumer device to 
fu communicate with any other device attached to the network. Many consumers are already 
It) beginning to install PC networks in their homes to share, for example, a cable modem or digital 
^=2 subscribed line (DSL) fast internet connection. Moreover, in home digital networks (IHDNs) 
have been proposed to interconnect a multiplicity of IDDs. The devices connected to such an 
IHDN can communicate with another over any suitable communications medium, e.g., via an 
IEEE 1394 serial communications bus, also known as "Fire Wire", or via a wireless 
25 communications medium. The IHDN would solve many existing problems of combining devices. 
Connecting a television, a VCR, a satellite dish, a PC, a stereo and six speakers would no longer 
require dozens of cables, multiple splitters purchased at an electronics store, and a degree in 
electrical engineering. All that would be required is connecting each of these devices to the 
IHDN and turning it on. However, these connected IDDs could still not operate in concert. 
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What is needed is a method and corresponding system permitting the exchange of 
information between IDDs. Preferably, what is needed is a method and corresponding system 
permitting the exchange of information to initiate an operation responsive to receipt of the 
5 exchanged information by one of the devices on a network. It would be beneficial if the method 
and corresponding system could operate on a plurality of the exchanged information. What is 
also needed is a method to facilitate data exchanges between incompatible intelligent digital 
devices connected to one another via an IHDN. 

10 

SUMMARY OF THE INVENTION 

Based on the above and foregoing, it can be appreciated that there presently exists a need in 
the art for a method and corresponding system which increases the interoperability of intelligent 
15 digital devices connect via an in home digital network. The present invention was motivated by a 
desire to overcome the drawbacks and shortcomings of the presently available technology, and 
thereby fulfill this need in the art. 

In one aspect, the present invention provides a method of operating an intelligent digital 
20 device (IDD) receiving an extensible Markup Language (XML) document containing data and 
respective Document Type Definition (DTD) describing the data content. Preferably, the method 
includes steps for verifying that a received DTD satisfies a predetermined criteria, and operating 
on the data contained in the XML document. In an exemplary case, the IDD maintains a list of 
trusted DTDs and the predetermined criteria is equality between the name of the received DTD 
2 5 and the name of a trusted DTD. Alternatively, the predetermined criteria comprises the inclusion 
of the name of a program residing on the IDD. 

In another aspect, the present invention provides a method of operating a system 
including a digital network interconnected intelligent digital devices (IDDs) generating and 
30 receiving extensible Markup Language (XML) documents containing data and respective 
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Document Type Definitions (DTDs) describing the data content. Preferably, the method includes 
steps for transmitting a generated XML document from a first IDD to a second IDD, and, when 
the respective DTD for the generated XML document satisfies a predetermined criteria, operating 
on the data contained in the XML document at the second IDD. In a first exemplary case, the 
5 second IDD maintains a list of trusted DTDs, and the predetermined criteria is equality between 
the name of the respective DTD and the name of a trusted DTD. Alternatively, the 
predetermined criteria comprises the inclusion of the name of a program residing on the second 
IDD. In a second exemplary case, the transmitting step includes transmitting the generated XML 
document from the first IDD to the second IDD and a third IDD, the operating step includes 

10 operating on the data contained in the XML document at the second IDD when the respective 
DTD for the generated XML document satisfies a first predetermined criteria, and the method 
further includes the step of operating on the data contained in the XML document at the third 

11 IDD when the respective DTD for the generated XML document satisfies a second 

J* predetermined criteria. 

i§ 

^ In yet another aspect, the present invention provides a method of operating a system 

-2 including a digital network interconnected intelligent digital devices (IDDs) generating and 
^ receiving extensible Markup Language (XML) documents containing data and respective 
J* Document Type Definitions (DTDs) describing the data content. Advantageously, the method 
12) includes steps for: 

*S (a) generating an XML document containing related data and a reference to a respective 

DTD at a first IDD responsive to a command from a second IDD; 

(b) transmitting the XML document from the first to the second IDD; 

(c) when the respective DTD satisfies a predetermined criteria, parsing the data in the XML 
2 5 document in accordance with the format described in the respective DTD to thereby generate parsed 

data from the related data; and 

(d) operating on the parsed data. 

In a still further aspect, the present invention provides a system including a plurality of 
30 intelligent digital devices (IDDs) interconnected to one another , each of the IDDs being capable 
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of one of generating and receiving an extensible Markup Language (XML) document containing 
data and referencing a document type definition (DTD). The system is further characterized in 
that: 

a first IDD generates the XML document responsive to a command received over the 

5 IHDN; 

a second IDD stores N XML processors associated with N named DTDs; 

a third IDD stores M XML processors associated with M named DTDs; 

the second IDD processes the XML document using one of the N XML processors when 
the respective DTD corresponds to one of the N named DTDs; 
10 the third IDD processes the XML document using one of the M XML processors when 

the respective DTD corresponds to one of the M named DTDs; and 

N and M are both positive integers. 

Preferably, in the above-mentioned system, at least one of the N named DTDs and at least 
IS one of the M named DTDs are identical to the respective DTD, while the one of the N XML 
|y processors corresponding to the respective DTD is different than the one of the M XML 

processors corresponding to the respective DTD. In an exemplary embodiment, the second IDD 
* stores the N named DTDs, while the third IDD stores the M named DTDs. Alternatively, the 
f y second and third IDDs store lists of trusted DTDs including the associated N and M named 
It) DTDs, and the first IDD generates the XML document and the respective DTD responsive to the 
%3 command received over the IHDN. The IDD's advantageously can be interconnected via an in 

home digital network (IHDN). 

2 5 BRIEF DESCRIPTION OF THE DRAWINGS 

These and various other features and aspects of the present invention will be readily 
understood with reference to the following detailed description taken in conjunction with the 
accompanying drawings, in which like or similar numbers are used throughout, and in which: 

FIG. 1 is a high level block diagram of an intelligent digital device (IDD) connected to an in 
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home digital network (IHDN); 

FIGS. 2 A and 2B are alternative configurations of the LUT 128 illustrated in FIG. 1 ; 
FIG. 3 is a representation of the entertainment and information system of the present 
invention, particularly illustrating how the invention can be used to exchange information based on 
5 electronic program guide (EPG) data; 

FIG. 4 illustrates the format of an XML(EPG) document which can be transmitted over the 
IHDN illustrated in FIGS. 1 and 3; 

FIG. 5 illustrates the format of a document type definition (DTD) associated with the 
XML(EPG) document illustrated in FIG. 4; 
10 FIG. 6 is the output VRML 3D output produced for a sample data set of the EPG data in a 

particular embodiment of the invention; and 

FIG. 7 is a high level flowchart illustrating an exemplary embodiment of the method of 
%j operating one of the IDDs upon receipt of the XML( EPG) document; 

_ll FIG. 8 shows VRML commands as generated by the parsing of the XML (EPG) document; 

l§ and 

Id FIG. 9 is a representational diagram of the multilevel process by which EPG data is 

converted to a 3D EPG display. 

U DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

U Illustrative embodiments and exemplary applications will now be described with reference 

to the accompanying drawings to disclose the advantageous teachings of the present invention. 

While the present invention is described herein with reference to illustrative embodiments 
25 for particular applications, it should be understood that the invention is not limited thereto. Those 
having ordinary skill in the art and access to the teachings provided herein will recognize additional 
modifications, applications, and embodiments within the scope thereof and additional fields in 
which the present invention would be of significant utility. 



-6- 




As mentioned above, many manufacturers and device vendors have been searching for the 
next "killer" application for the modern home. One candidate is an in home digital network 
(IHDN), which advantageously could be used to interconnect all of the accoutrements of a modem 
home, e.g., DTV, DVD player, surround sound system, several PCs, etc. This integrated 
5 entertainment and information system is envisioned to include components which will exchange 
data, and preferably act on the exchanged data, in a manner which is completely invisible to the 
system user(s). However, when such a system is fabricated from current electronic components, the 
system still has the limitation that not every device connected to the IHDN will understand how to 
communicate with other devices attached to the IHDN. 

10 

In terms of the integrated entertainment and information system, once all of the devices in 
the home are connected together, either hardwired or by a broadcast connection, a communications 
(j standard, or common language, is still required so that all of the devices can be understood by all 
H the other devices, i.e., so the connected devices can exchange information and cooperate. The 
i I language must be : 

% y • Flexible enough to support a wide array of devices; 

% • Extensible, so new classes of devices can be supported; 

5 • Easily Parsed by processor and memory constrained devices; and 

If y • An open standard with broad industry backing. 

r *= ! The present invention solves this problem by employing a method in which XML, a 

language which possesses all of the qualities required in a communications standard for the IHDN, 
is used in a new way to solve the problem of device interconnectivity. In other words, the method 
and corresponding system according to the present invention overcome the above-identified 

25 problem by fabricating the system from intelligent digital devices (IDDs). In the inventive system, 
each of the IDDs is capable of generating and/or receiving an extensible Markup Language (XML) 
document. Moreover, IDDs capable of receiving the XML document store at least one XML 
application for processing the data contained in the XML document in accordance with a document 
type definition (DTD). These features of each IDD will be discussed in greater detail below. Before 
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a detailed discussion of the EDD is undertaken, a brief discussion of the XML standard, which is a 
subset of the SGML standard, will be presented. 

^^^SGlfeL, an acronym for Standard Generalized Markup Language, is an international 
standard (IS© 8879:1986) and is a markup language used extensively in publishing and other 
domains. Additional material on SGML is included in* the document entitled "A Gentle 
Introduction to\SGML" 9 Text Encoding Initiative, which can be obtained from the web page 
http://www-tei.m&.edu^ Moreover, XML is a markup language 

based on SGML, lb either case, "markup" denotes that the information is annotated (or marked up) 
with tags. Tags surfound a section of information (called content) and define the properties of the 
content. A more detailed explanation is provided in the article by M. Bryan, entitled "An 
Introduction to the Extensible Markup Language (XML)", which is available from The SGML 
^ Centre, at http://www.ftersonal.u-net.com/-sgmyxmlintro.hto and the paper by Jon Bosak entitled 
y "XML, Java, and theY Future of the Web", which is available from Sun Microsystems at 
S http://metalab.imc.edu/piW^ It should be noted that all of 

the documents mentioned Vbove are incorporated herein by reference. 

The XML standard is the result of an effort by the World Wide Web Consortium (W3C) to 
enable the further expansion of Web technology into new domains of distributed document 
2gj processing. The first officially released specification for XML from W3C was released on Feb. 10, 
^ 1 998 and the specifications for required related standards are still being formulated. 

XML is used to capture structured data and text. In contrast, Hypertext Markup Language 
(HTML), the language used to develop Web pages, is capable of capturing multimedia documents. 
Any inherent relationship between the information captured in an HTML document is lost. For 
example, text annotated in HTML could have the form <bold> text </bold>, indicating that the 
included text would be displayed in a bold font. In contrast, data annotated in XML would have the 
form <program-type> text </program-type> ? indicating that the data between the tags denotes the 
genre of a movie in an electronic program guide (EPG)). It is important to note that in XML, these 
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data relationships are preserved and can be used by the receiver of the XML document. It should 
also be mentioned that there are several related standards for XML that specify how to display and 
link XML documents; this suite of XML standards, used together, can capture, display and link 
together highly structured information in an effective way. 

5 

As mentioned immediately above, an important feature of XML is that it separates the data 
from how that data should be displayed. This is useful because it allows the same XML document 
to be used by multiple IDDs for different purposes. Since each IDD advantageously can display the 
data in an appropriate manner, the XML document is flexible and reusable. 

10 

It should be mentioned that the manner is which each IDD employs the XML documents it 
receives is determined by the Document Type Definition (DTD). The DTD defines the structure of 
q the XML document including what each tag represents. It should also be mentioned that each IDD 
''H advantageously can have its own set of DTD(s) that is (are) applied to the XML documents that the 
1§ IDD receives. Moreover, as mentioned below, the referenced DTD in an XML document 
£ j advantageously can be employed to initiate operation of a specific program residing on a respective 
'-V1 IDD on the received XML document. See Fig. 7. It will be appreciated that several EDDs can have 
;s different versions of, for example, a VRML interpreter, each version generating a VRML world, as 
Jj i discussed in greater detail below with respect to Fig. 6, sized to a different display device. In this 
14 way, each IDD can use the same XML document and associated DTD to produce, for example, an 
y IDD-specific presentation. Moreover, as discussed in greater detail below, substantially identical 
versions of a XML document advantageously can be formatted for display and presentation, in an 
exemplary case, by merely editing the DTD name included in the XML document to thereby 
instantiate a different XML application. 

25 

The ability of the IDDs to generate, transmit, receive, and process XML documents in 
accordance with respective DTDs are features essential to creating a flexible and scalable IHDN. 
The entertainment and information system according to the present invention thus consists of a 
plurality of IDDs connected through a network and communicating with one another using XML 
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documents. As discussed in greater detail below, each IDD contains an XML parser or processor 
that allows the IDD to read an XML document and a DTD (or set of DTDs) that allows the IDD to 
understand XML documents received across the network. 

5 A high level block diagram of an exemplary IDD 100 is illustrated in FIG. 1 as including 

processor 110 receiving instructions from a memory 120 via a bus 130. It will be appreciated that 
the memory 120 advantageously can include a read-only memory (ROM) 122, a random access 
memory (ROM) 124, and a general purpose memory 126, which could be a hard disk drive, a CD- 
ROM, etc. It will also be appreciated that the bus 130 can include a number of general and special 
10 purpose buses known to one of ordinary skill in the art. The processor 110 preferably is connected 
to the IHDN 200 via a first input/output (I/O) device 140 and is connected to another device, e.g., a 
display 1 60, via a second I/O device 1 50. 

~l= Preferably, the memory 120 stores at least one XML application for generating and parsing 

t% XML documents. Advantageously, the XML application may also build or facilitate the building of 
y XML documents and associated DTDs. In addition, the memory stores the operating program(s) of 
J« the IDD, which program(s) advantageously can include(s) a routine for instantiating the XML 
* application when (a) an XML document has been received by the IDD 100 and (b) a predetermined 
I y condition is satisfied. 

u In an exemplary case, the 120 stores a look up table (LUT) 128 employing the names of 

trusted DTDs at pointers to respective XML applications, where trusted DTDs are DTDs that have 
tested satisfactory when communicating between IDD 100a and 100b, for example. It will be 
appreciated that trusted DTDs need not be supplied by the vendor of the specific EDD. It will also 

25 be appreciated that the memory 120 need not store the actual trusted DTD; the associated XML 
program can be instantiated as long as a match occurs between the DTD referenced in the XML 
document and the name of the trusted DTD stored in LUT 128. Alternatively, the memory 120 
advantageously can store the trusted DTDs, which saves bandwidth in the IHDN 200. See FIGS. 
2A and 2B. 
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As previously discussed, the present invention employs XML documents as a data exchange 
mechanism, allowing various and diverse IDDs 100 to share data between themselves over the 
IHDN 200. One exemplary embodiment of an entertainment and information system 1 according to 
the present invention is illustrated in FIGS. 3-9 with respect to conveying Electronic Program 
Guide (EPG) data between several IDDs over the IHDN 200. 

Referring to FIG. 3, it will be appreciated that one way to conceptualize the entertainment 
and information system 1 is by means of the display-centric model being investigated by one of the 
High Volume Electronics (HVE) strategy groups working in consumer electronics product 
planning. In this model, a consumer buys a display IDD 100a, e.g., a flat panel display, an 
entertainment IDD 100b, e.g., a cable/terrestrial/satellite receiver (a.k.a. set-top-box (STB)) which 
performs all of the audio/video/data decoding functions, an information IDD 100c, e.g., WebTV or 
similar technology for obtaining Internet content, a recorder IDD lOOd, e.g., a digital video recorder 
or a RePlay recorder, and a computer IDD lOOe, i.e., a personal computer. All of the IDDs 100a- 
lOOe are operatively connected to one another via the IHDN 200. It will be appreciated that the 
information IDD 100c can be connected to the Internet (400) via a plain old telephone system 
(POTS) 300, so that data can be gathered from various data sources, e.g., 402A-402C. 

It should be noted that several of the IDDs, e.g., entertainment IDD 100b and information 
IDD 100c advantageously can be combined in a single IDD lOOx, although these IDDs are shown 
separately in FIG. 3. It should also be noted that the notation IDD is employed throughout to 
denote the wide scope of the present invention. For example, a nourishment IDD lOOf, e.g., a 
microwave oven, and a speaker system IDD lOOg advantageously can be connected to and form 
part of the entertainment and information system 1 according to the present invention without 
departing from the spirit and scope of the invention. Moreover, it will be appreciated that the 
interconnection of multiple IDD's 100 via the IHDN 200 represents only a single preferred 
embodiment according to the present invention. The IDD's 100 advantageously can be 
interconnected via the internet, a wireless network, a local area network, a wide area network or a 
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virtual private network. 



In the exemplary preferred embodiment of the invention illustrated in FIG. 3, the 
entertainment IDD 100b, e.g., the STB, receives raw Electronic Program Guide (EPG) data sent by 
5 the broadcaster or cable operator as part of the Program and System Information Protocol (PSIP) 
standard. See FIG. 9. The EPG data is saved in a database stored in memory 120b located in the 
IDD 100b. The processor 1 10b in the IDD 100b then constructs an XML document model out of 
the raw data, i.e., the EPG data retrieved from the database in memory 120b, and transmits the 
XML packaged EPG data (hereinafter XML(EPG) document) to the display IDD 100a. In the 
1 0 exemplary embodiment being discussed, the XML(EPG) document includes a reference to a Virtual 
Reality Modeling Language (VRML) DTD, as illustrated in FIG. 4; the exemplary VRML. DTD is 
illustrated in FIG. 5. As previously mentioned, the IDD 100b need not actually generate the 
12 VRML.DTD (although the IDD 100b could generate the applicable DTD when required). The 
^ XML(EPG) document (and the VRML.DTD) is (are) transmitted to the IDD 100a, where the 
if XML(EPG) document is converted for display on display 160a via the VRML 3D encoder 
!L y instantiated by processor 1 1 0a. A representative screen capture of the VRML output is illustrated in 

fig. 6. 

if U Referring now to FIG. 7, the method for operating the entertainment and information system 

'H) 1 will now be explained in detail. More specifically, FIG. 7 is a high level flowchart of a method 
\j for operating the entertainment and information system 1 according to the first preferred 
embodiment of the present invention. During step S10, XML(EPG) document is received at IDD 
100a from IDD 100b via IHDN 200. Then, during step S20, a check is performed to determine 
whether the XML(EPG) document references a trusted DTD, i.e., the VRML.DTD, which 
25 advantageously can be listed in LUT 128 of IDD 100a It will be appreciated from FIGS. 2A and 
2B that it is immaterial to the present discussion whether the trusted DTD referenced in the 
XML(EPG) document is transmitted via the IHDN 200 or stored in memory 120 of IDD 100a. 
When the answer is negative, the operating program of the IDD 100a jumps to step S50 and 
performs a check to determine whether the XML(EPG) document references an EPG.DTD. 
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If the answer at step S20 is affirmative, the processor 1 10 instantiates the XML processor 
stored in memory 120 during step S30 and instantiates the VRML interpreter stored in memory 120 
during step S40. The XML processor parses the EPG data in the XML(EPG) document and outputs 
selected portions of the EPG data to the VRML interpreter, which, in turn, interprets the parsed 
EPG data and generates VRML data, as illustrated in FIG. 8, representing a three dimensional (3D) 
VRML "world" projected on the screen of the IDD 100a. See FIG. 6, which, as previously 
mentioned, is a screen capture of a VRML world depicting selected portions of the EPG data, as 
discussed in greater detail below. 

When the answer is affirmative at step S50, the processor 110 instantiates an XML 
application during step S60, which parses the EPG data in the XML(EPG) document and outputs 
selected portions of the EPG data to the screen of the IDD 100a as EPG data in a grid form. When 
the answer is negative at step S50, the routine loops back to the start (step S10) to await the arrival 
of the next XML document. 

Similarly, the IDD 100c, e.g., the WebTV unit or similar component, advantageously can 
receive Web content in XML or convert HTML into XML/DOM (Document Object Model). The 
IDD 100c can transmit the XML(HTML) document to the IDD 100a for display. Likewise, the 
recorder IDD lOOd, e.g., a video recorder, also connected to other devices via the IHDN 200, 
transmits its table of contents (TOC) in XML format, i.e., transmits an XML(TOC) document to the 
IDD 100a for conversion to VRML for display. Thus, the IDD 100a, which advantageously 
includes an XML parser and a VRML decoder (interpreter and 3D pipeline), can interact with any 
other IDD to display data received in XML format. 

It will be appreciated that the present invention is not limited to the exemplary embodiment 
described above. For example, it will be appreciated that IDD 100a advantageously can display 3D 
data representing the output of a plurality of data sources, e.g., IDDs lOOb-lOOd, so that the user(s) 
can view and information residing on or obtainable via the entertainment and information system 1 . 
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Moreover, it will be appreciated that since the reference to a trusted DTD can be the trigger which 
initiates the operation of an XML processor or XML application, receipt of two such XML 
documents or DTDs advantageously can signal the initiation of a third XML application. In an 
exemplary case, when the XML(EPG) and XML(TOC) documents are both received by the IDD 

5 100a, an exemplary XML application called SORT can be instantiated to examine the XML(EPG) 
document corresponding to the displayed VRML world for coincidences and/or discontinuities. In 
an illustrative case, the SORT XML application could be employed to determine that a particular 
program was marked as being of interest to the user but has not been designated for recording by 
recorder IDD lOOd. It will be appreciated that an updated TOC for the IDD lOOd advantageously 

0 could be transmitted from the IDD 1 00a to the IDD 1 OOd as a second XML(TOC) document. 

In order to better understand the IHDN described in this particular embodiment of the 
invention, a more detailed discussion regarding the movement of Electronic Program Guide (EPG) 
data from IDD to IDD will be presented. It will be appreciated that EPG applications will be more 
prevalent both as DTV becomes more prevalent and as the number of channels available to the user 
continues to grow. It will be appreciated that current two dimensional (2D) method of formatting 
data for display to the user do not scale up to the eventual 500+ channels predicted for DTV. 

The EPG- VRML application discussed above is a three dimensional (3D) representation of 
the programs available in a graphic format similar to the layout appearing in most U.S. newspapers. 
The advantage of this representation over the 2D representation is that the 3D representation is 
scalable, i.e., the 3D display advantageously can accommodate the large numbers of channels that 
will be available to consumer in the near future. As mentioned above, the application was 
developed using VRML to display the EPG. 

It should be mentioned that the EPG data is a structured data set which is very large. 
Advantageously, XML is designed to work with structured data and can handle arbitrarily large 
documents. Moreover, the EPG data is composed of text based information; XML works with text 
based documents. It will be appreciated that XML documents can reference files containing non- 
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textual data, i.e., images, sounds, etc. 



# 



The XML EPG document must capture all of the information necessary to display both a 
concise listing of the programming available and a more verbose descriptive listing of the programs 
5 available. A Document Type Definition (DTD), as documented in XML literature, describes the 
data to be included in the XML(EPG) document. This DTD is depicted in FIG. 5. It will be noted 
that the VRML.DTD indicates the name of the processing application which advantageously can be 
used to further manipulate the EPG data, as discussed in greater detail below. 

0 It will be noted that the DTD describes how all of the individual data elements associated 
with each television program are composed and related to each other. The DTD also describes how 
all of the television programs are grouped together to create an XML(EPG) document that captures 
all of the available programming on all of the available channels for some predetermined time 
period. Preferably, the XML(EPG) document must contain specific information about each 

1 program available to be useful to a user. The EPG document must, at a minimum contain the name 
of each available television program, the start time, the end time, and the channel for every 
television program. Additionally, each television program in the XML(EPG) document has a broad 
category label, indicating the type of program, i.e., comedy, musical, etc. A description of each 
television program would also be useful to the user, and as such is included in the XML(EPG) 
document and the associated DTD. As a possible extension, additional category specific 
information can also be included with the television program. For example, a movie listed in the 
EPG data advantageously can indicate the name of the director while a sporting event would 
indicate the type of sport being played and names of the players or teams playing. 

5 As mentioned above, one partial example of the XML(EPG) document is depicted in FIG. 

4. It should be noted from FIG.4 that the name of the channel associated which this television 
program may not be needed by the EPG. In that case, the channel identification will simply be 
discarded when the IDD 100a parses the XML(EPG)document and displays the 3D representation 
of the EPG data to the user. 
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It will be appreciated that the data representation in XML is highly scalable. Any number of 
programs on any number of channels can be added to the XML document and transmitted to the 
EPG application via entertainment EDD 100b ? IHDN 200, and display E)D 100a, which would 
5 cooperatively take the EPG data, parse it, and display the 3D representation of the EPG data, i.e., 
the VRML world, for the user. XML can therefore be used as the data transmission facilitator, even 
as the number of channels and programs increases over time. 

Once the XML(EPG) document is received by the XML processor and VRML interpreter 
instantiated by processor 1 10a, the document is processed and displayed. For this application, the 
EPG data within the XML(EPG) document is converted to VRML data by the VRML interpreter 
and displayed for the user to browse and navigate. The parsing of the EPG data in the XML(EPG) 
document and the conversion of the parser's output to VRML format is performed by the XML 
processor and VRML encoder running on processor 1 10a. It is important to note that, because the 
EPG data is encoded in XML, a different XML application corresponding to a different method of 
displaying the EPG data could be substituted for this application (See FIG. 7.) without requiring any 
changes to the XML(EPG) document or the transmission mechanism, with the possible exception 
of modifying the DTD name in the XML(EPG) document. In short, an XML application is simply a 
consumer of the XML(EPG) document and does not need to know anything about the origins of the 
XML(EPG) document or how this document was delivered to the XML application. The originator 
of the EPG data in the XML(EPG) document could also be replaced without affecting the display of 
EPG data in any meaningful way. 

It will be appreciated that parsing the XML(EPG) document entails walking through the 
XML document and collecting up all the relevant information, in an exemplary case, about each of 
the programs in the XML document. This information must then be translated into a useful VRML 
representation of the data, which is a relatively straightforward transform understood by one of 
ordinary skill in the art. A selected portion of the VRML program data is shown in FIG. 6; a 
selected portion of the VRML commands is depicted in FIG. 8. 
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The EPG VRML program data is used by the EPG application to display all of the programs 
in the VRML visual display to the user. This allows the data to change, but keep the same visual 
.VRML representation. 

A functional diagram depicting the entire process, from receiving EPG data at IDD 100b to 
displaying the 3D visualization of the EPG data on display IDD 100a application, including an 
exemplary data transformation, transmission, and display sequence is illustrated in FIG. 9. In FIG. 
9, it is assumed the raw EPG data is not saved in XML format and must be converted to XML by 
EDD 100b. Before the data is converted to XML, it is cleansed of any erroneous or unnecessary data 
points and saved in memory 120b of IDD 100b. The cleansed data can then be formatted into a 
structure that makes conversion into XML easier. It will be appreciated that this may involve 
2 ordering the data in a consistent way and collecting related data records together. Once this step has 
i been completed, the data is converted to and XML representation, based on the selected DTD for 
EPG data, by processor 1 10b. 

The XML(EPG) document is then transmitted to the display IDD 100a for display. Once 
received by the IDD 100a, the XML(EPG) document is parsed and converted into the format 
necessary for display, using the referenced DTD. See FIG. 7. In the exemplary case under 
discussion, the XML processor parses the XML(EPG) document and generates data suitable for 
application to the VRML interpreter, which generates the VRML data corresponding to the EPG 
data. This VRML code is then combined with the VRML code that describes the 3D VRML world 
structure. Once this step is completed, a VRML world containing a 3D representation of current 
EPG data is ready for display on IDD 100a. 

It will be appreciated from FIG. 7 that the VRML world has many features to aid the user in 
navigating the EPG data in a useful manner. The user can visually highlight categories of programs, 
programs within specific time periods, or some combination of the two. The user may also select 
channels of interest and move up and down through the vast selection of available channels. It is 
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also possible to display a preview of some of the programs on the preview screen above the EPG 
program listings. It will be noted that the day tower at the nexus of the channel axis and time axis is 
used to change the day being viewed. 

It should be noted again that all of the documents, articles and papers cited above 
are incorporated herein by reference. Moreover, is should again be stressed that while the 
mechanism by which the various IDD's are interconnected is described as an IHDN with respect to 
one preferred embodiment, the present invention is not limited to IDD's interconnected in this 
manner. The IDD's can also be interconnected via the internet, a virtual private network, a wireless 
network, a local area network, or a private wide area network without departing from the scope of 
the present invention. 

Finally, it should be noted that many of the tools currently available for working with XML 
can be obtained for free. Many are simple experiments by individuals interested in exploring this 
new domain, some are beta versions of tools that companies plan on selling at some point in the 
future, and other tools are released by companies as freeware in the hopes that it will spur the 
movement of development efforts on the Internet towards XML and other products sold by these 
companies. 

Although a presently preferred embodiment of the present invention has been described in 
detail hereinabove, it should be clearly understood that many variations and/or modifications of the 
basic inventive concepts herein taught, which may appear to those skilled in the pertinent art, will 
still fall within the spirit and scope of the present invention, as defined in the appended claims. 
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